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1. Introduction 



A statistical technique for post-processing tropical cyclone tracks predicted 
by the Fleet Nunerical Oceanography Center (FNOC) Tropical Cyclone Model (TCM) 
lias been devised by ELfoerry and Frill (1980) . The technique uses multiple 
linear regression equations to ranove systanatic bias in the TCM track forecasts . 
Predictands of the equations are zonal and meridional differences betv^en fore- 
cast and best track positions at corresponding times. Predictors are storm lati- 
tude and longitude, Julian date, and zonal and meridional conponents of model- 
predicted displacanent and velocity. Mditional predictors are obtained by inte- 
grating the model backward in time to -36 h, and cailculating the differences be- 
tween the knowi positions at -12, -24 and -36 and the corresponding backward in- 
tegration positions. ELfoerry and Frill found that these backward track predic- 
tors were very valuable, because they indicate the forecast track errors due to 
model and initial data deficiencies . That is , the errors that occur in the 
backward portion of the track may be used to help define the expected errors in 
the forward portion. The technique reduced ICM independent sample forecast 
errors by ~1(X) rmi at 72 h. 

ELdcerry, Gilchrist and Eteak (1981) showed that the same technique can be 
used to improve forecast tracks of the Hurricane and Typhoon Tracking (HATRACK) 
scheme. The HATRACK error reduction was also ~100 rmi at 72 h. 

The reduction of forecast errors in these research studies is encouraging; 
however , there are problaris with implemoiting the techniques in an operational 
mode. The TCM regression schane tests were restricted by the use of analysis 
fields for forward integration boundary conditions ("perfect prog"), rather than 
hanispheric model forecast fields. Best track storm positions, which are not 
available operationcilly, have been used rather than warning track positions. The 
additional ccmputer time required for integrating a model backwards is a 



potential problem oi an operational system. Elsberry and Frill (1980) indicated 
that changes in a predictive model, and in the data used by the model, may tend 
to invalidate the regression equations. The version of the TCM now used 
operationally at FNOC is different frcm the one that Elsberry and Frill used. 

The differences include a new method for location of the initial model grid rela- 
tive to the initial storm center, a stronger storm bogus and a pre-processing 
technique developed by Shew::huk and Elfoerry (1978). As will be seen later, the 
model no longer exhibits the same error bias characteristics because of these 
changes. The model is currently initialized with the FNOC northern hemisphere 
primitive-equation model and global band fields , but will in the near future be 
initialized with fields frcm the tfevy (^rational Global Atmospheric Prediction 
System (NOGAPS) . These new data may further change the model bias. 

The purpose of this report is to explore further the usefulness of 
statistical postprocessing for FNCC operational models. The operational TCM 
(hereafter referred to as TCMO) is evaluated for the effects of model changes on 
systanatic bias, and the post-processing technique is applied to the operational 
tracks. In addition, the TWo-Way Interactive Ifested Tropical Cyclone Madel 
(NTCM) is evaluated for bias and applicability of the postprocessing technique. 
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2. Backward Extrapolation versus Backward Integration 

The original ELsberry and Frill statistical regression schene requires an 
additional integration of the TCM to predict the 36 h backward displacem^t of 
the storm. The backward track provides a comparison of the model performance to 
known previous storm positions at -12/ -24 and -36 h. This backward track com- 
parison is crucial in statistically determining the corrections to be made to the 
forward motion forecast. The necessary TOVl modifications include re-defining the 
time interval to be negative rather than positive and setting the analytic heat- 
ing function to zero. The main disadvantage of this method is the approximately 
50% increase in computer time required per model run to provide the backward 
track. The lack of heating in the backward integration mode may cause the model 
to predict an unrepresentative track, or perhaps permit dispersion of the vortex 
circulation so that it is impossible to track the center of the vortex to -36 h . 

A method for avoiding a backward integration of the model has been devised. 

It ^^s noticed that the 36 h backward trajectories of the HATRACK model were 
quite similar to simple backward extrapolation of the speed and direction com- 
ponents of the 12 h, 24 h and 36 h forward trajectories (Fig. 1). This is 
because the HATRACK model represents a storm as a point vortex advected by a 
snoothed, large-scale steering flow. Because of this similarity, comparing the 
backward extrapolated tracks with the known prior positions may provide the same 
model bias information as if the comparison is with the backward integration 
tracks. If the regression scheme could work with backward extrapolation, there 
would be no need to modify the HATRACK model to run backward. The operational 
implementation of the scheme would require little more than a means for input of 
the -12 h, -24 h and -36 h ^^ming track positions and the addition of a 
regression equation subroutine. 
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MEAN ERROR 



Y 




Fig. 1 Methcxi of backward extrapolation of model-predicted 
stom tracks at 12, 24 and 36 h to obtain positions 
at -12, -24 and -36 h in lieu of a backward integra- 
tion of the model 




FORECAST riME(H) 

Fig. 2 Mean TG^ forecast errors (n.mi.) for 82 western north 
pacific tropical cyclone cases. Mean errors are 
depicted for the urmodified dependent (UM^CD DEP) and 
independent (UNMCD IND) samples, and the regression 
modified samples using backward integration (BI) and 
backward extrapolation (BE) positions 
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Extrapolated backv/ard tracks and corresponding regression equations vere used 
in lieu of the backward trajectories of Elsberry, Gilchrist and Peak's 
scheme to test the effect on the regression scheme performance. The conparison 
of the HATRACK regression schone independent sample modified with equations based 
on backward integration and the same sample modified with equations based on 
backward extrapolation can be seen in ibble 1. Ihe improvanent relative to HAT- 
RACK made by the backward extrapolation scheme is conparable to that by the back- 
ward integration schane in terms of the reduction of mean error and in the stan- 
dard deviation of forecast error. The success of the backward extrapolation 
schane may be attributed to the extrane anoothing of the height fields and the 
simple vortex advection procedure of the HATRACK model . It is unclear vhether 
the extrapolation method will work for more complex, dynamical models such as the 
TCM or the NTCM. Such an approach is based on the assumption that the model' s 
systanatic bias during the early stages of forward integration is similar to that 
vhich would be found in backward integration. If the extrapolation schane can 
provide the necessary bias information for the regression equations, it would 
have advantages . The computer time needed to perform backward integration would 
no longer be necessary, nor would any modification of the model be required, thus 
providing a faster, less expensive post-processed forecast. Finally, all previous 
model runs could be used in deriving regression equations without the requiranent 
of calculating a backward integration track for each of the historical cases. 

Ihe feasibility of using backward extrapolation to replace backward integra- 
tion was tested using 82 TCM runs . Backward integration tracks and statistical 
regression equations already have been derived for this sample. Ihe track error 
biases of the 82 cases ( frcm 26 storms) are listed in Ibble 2. Ihe negative zonal 
( Ax) bias and positive meridional ( Ay) bias indicates that the TCM forecast 
tracks are v^st and south of a typical storm track toward the northwest . 
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TABLE 1 



Means (X) and standard deviations (a) of HATFACK forecast errors (mi) for 
500 rtto, 700 mb and 850 mb independent samples; unmodified, modified using back- 
ward integration positions, and modified using backward extrapolation positions. 



500 mb 





Independent 


Independent 


Independent 




Umodified 


Mcxiified 


>t3dified 


Forecast 






( Integration) 


(Extrapolation) 


Time 


X 


a 


X 


a 


X 


a 


12 


78 


47 


51 


37 


46 


27 


24 


150 


91 


104 


56 


90 


60 


36 


229 


136 


152 


87 


145 


100 


48 


310 


181 


220 


146 


205 


155 


60 


387 


229 


296 


212 


289 


212 


72 


473 


259 


377 


252 


366 


241 





Independent 


700 mb 
Independent 


Independent 




Umodified 


Modified 


Modified 


Rjrecast 






( Integration) 


( Ex tr apol a tion ) 


Time 


X 


a 


X a 


X a 


12 


81 


43 


51 


32 


45 


26 


24 


163 


81 


93 


56 


90 


58 


36 


245 


122 


145 


93 


153 


100 


48 


325 


164 


217 


141 


230 


171 


60 


403 


204 


304 


190 


307 


244 


72 


466 


225 


371 


220 


388 


280 





Independent 


850 mb 
Independent 


Independent 




Umodified 


Modified 


Modified 


Eto recast 
Time 


X 


0 


( Integration) 
X a 


( Extrapolation) 
X a 


12 


83 


41 


49 


28 


44 


26 


24 


164 


73 


92 


53 


83 


51 


36 


243 


115 


147 


75 


141 


80 


48 


322 


168 


224 


166 


215 


156 


60 


397 


227 


298 


215 


272 


227 


72 


450 


268 


332 


241 


342 


233 
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TABI£ 2 



TCM mean 


forecast errors 


(rmi) for 


82 v«estem North 


Pacific Ocean cases 


Ebrecast 

Time 


Nun±)er of 
Gases 


Ebrecast 

Error 


Zonal (Ax) 
Error Bias 


Meridional (Ay) 
Error Bias 


12 


82 


69 


8 


14 


24 


82 


129 


-16 


45 


36 


79 


187 


-38 


59 


48 


67 


261 


-70 


86 


60 


60 


318 


-109 


104 


72 


53 


399 


-172 


164 



TABLE 3 

TWD-Vvay interactive OTCM mean forecast errors ( nmi) for 186 vestem North 
Pacific cases. 



Ebrecast 

Time 


Number 
of Gases 


Ebrecast 

Error 


Zonal (Ax) 
Error Bias 


t-feridional (Ay) 
Error Bias 


Right Angle 
Error Bias 


^3eed 

Error Bias 


12 


186 


74 


11 


-16 


20 


-32 


24 


186 


114 


-5 


-5 


15 


-46 


36 


186 


155 


-20 


-15 


17 


-43 


48 


185 


209 


-38 


-10 


8 


-47 


60 


162 


251 


-35 


-21 


4 


-36 


72 


160 


319 


-60 


-8 


-14 


-60 
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The 82 cases are randanly divided into 55 dependent cases and an independent 
sample of 27 cases . The redvx:tion of variances by the regression equations pre- 
viously derived frcm the dependent sample using backward integration positions 
ranged fran 46% to 73% and averaged 60%. ^few regression equations '/ere derived 
using backward extrapolation positions. The reduction of variance by these equa- 
tions ranges frcm 36% to 75% and averages 51%. The new equations chose a slightly 
analler proportion of backward track predictors to forward track predictors than 
was the case for the backward integration equations. This, along with the smaller 
reduction of variance, indicates that the backward extrapolation positions do not 
provide as much information about the TCM track bias as do the backward integra- 
tion positions. 

The mean forecast errors of the dependent and independent samples as modified 
by the statistical equations based on both backward integration and backward ex- 
trapolation are depicted in Elg . 2. The decrease in forecast error of the depen- 
dent sample is about the same for the two methods frcm 12 h to 36 h and at 72 h. 
Biavkever, the backward extrapolation method has 25-35 rmi larger errors at 48 h 
and 60 h. This is consistent with the extrapolation schone regression equations 
at 48 h and 60 h having the smallest reduction of variance. The independent 
sample post-processing decreased the forecast error frcm 12 h to 36 h by about 
the same amount for both schemes, but the improvenoit at 72 h by this backward 
extrapolation schene is only half as good as the 100 mi improvanent made by the 
backward integration scheme. In this case, the backward extrapolation scheme 
does provide a means for reducing forecast errors , but it does not eliminate as 
much of the bias as does the backward integration scheme. This indicates that 
the model probably does not exhibit the same systematic bias in the first 36 h of 
forvard integration as in backward integration. The improvement in forecast 
error and the selection of backward track predictors by tlie regression equations 
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are evidence that seme of the bias is accounted for by the bac3<ward extrapolation 
method. 

3. Right Angle and S^ed Error Bias Correction Scheme 

Typhoon track forecasts may also contain systanatic error bias relative to 
storm motion (right angle and speed errors) as ;^ell as in latitude/ longitude co- 
ordinates. Rnrecast right angle and speed errors as defined by FNOC are graphi- 
cally depicted in Eig. 3. Ignoring the earth's curvature, the forecast (vector) 
error is given by /fright angle error )^ + (speed error) The right angle and 
speed errors for a given forecast time depend only on the initial best track po- 
sition and the forecast and best track positions for that time. Notice especially 
that if the angle betveen the best track and the forecast track is greater than 
90*^, the right angle error is defined as the normal distance frem the forecast 
position to the line connecting the initial and future best track positions. The 
distance along this line frem the future best track to the intersection with the 
right angle error line is the "speed" error, so-called because it is the dis- 
placonent error that results fron the model's incorrect stom translation speed. 

Ihe regression post-processing technique of El^erry and Frill (1980) uses a 
latitude/ longitude coordinate systan, althoigh it can theoretically be used in 
storm coordinates to correct fbr right angle and speed error biases. In such a 
schane, right angle and speed error adjustments becone the predictands of the re- 
gression equations, rather than zonal and meridional adjustments. Due to the de- 
finition of right angle and speed error in cases vAiere a forecast track direction 

is in error by greater than 90° (Fig. 3b) , there is an ambiguity in applying the 

storm coordinate error and adjustments. The sane right angle and speed correctors 
may produce tvo different, valid best track positions. Rsr example, a negative 
right angle error ( forecast left of best track) and a negative speed error ( fore- 
cast is too slow) '>\hich is larger than the distance frem the initial best track 
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Fig. 3 Definition of right angle and speed error, Vvhere 

is the initial best track position, x is the future 
best track position; and a. the angle {9) between 
the forecast track and the best track is < 90°; 
b. 9 > 90° 




b. 




c. . 




ADJUSTMENT 



Fig. 4 Pour ways of applying right angle and speed adjustments. 
Symbols as in Fig. 3; and h is the distance from the 
intersection of the right angle adjustment line to the 
initial best track position, a. 9 < 90° and speed 
error adjustment > h, b. 9 > 90° and speed error adjust- 
ment > h, c. 9 < 90° and speed error adjustment < h, 
d. 9 > 90° and speed error adjustment < h 
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to the right angle error intersection point, can be applied as in Fig. 4a or Fig. 
4b. Both i^ays of applying the correctors predict a best track position more to 
the right (counteracting the error to the left) and farther along the best track 
line (counteracting the too- slow error) . Ch the other hand, if the right angle 
ard speed errors are negative and the speed error is smaller than the distance to 
the intersection betvveen the best track and the line defining the right angle 
error, the application in Fig. 4c is valid. In this case the position in Fig. 4d 
is not valid because the negative speed error adjustment must put the best track 
position farther along the best track line, not farther back. The position sliown 
in Fig. 4d vould be valid if the speed error was positive (forecast too fast) . 

When both best track positions are valid, the following criteria are used to 
choose the most likely to be correct: 

1) Successive track positions should be farther away fran the initial 
position ; 

2) If both positions are farther than the preceding forecast position, 
choose the one that is closest to the preceding forecast position; 

3) Successive positions should not change direction of motion by more 
than 90 degrees ; 

4) If both positions change direction of motion by more than 90 degrees, 
choose the one farthest away fran the initial position. 

In tests using actual right angle and speed errors as if they were correc- 
tors, these criteria resulted in the right choice for ambiguous situations in all 
but very unusual storm tracks, and the mean bias that was accrued fran wrong 
choices was approximately + 10 nm. 
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4. E^^st-Etocessing of NTCM Tracks 

a. Description of the data sample 

The model used in this experimait is the TVo-Way Interactive Nested 
Tropical Cyclone Madel (NTCM) . Recent NTCM performance evaluations have been 
made by tferrison (1981), Harrison and Fiorino (1982) and t^tsumoto (1981). In 
this study, the model is initialized vd.th analysis fields, and verified with best 
track positions. The data base, kindly provided by M. Fiorino and E. tferrison of 
the Naval Ervirormental Prediction Itesearch Ehcility (NEPRF) , consists of 186 
model runs on 36 storms. 

The error bias characteristics of the forecasts in the data base are 
shown in Thble 3, Fig. 5 and Fig. 6. The zonal error has a westward bias similar 
to, but analler than, the TCM, and a anall northward meridional bias. The right 
angle and speed bias reveals a tendency to forecast to the right of the best 
track (except at 72 h) and to be slow. 

Backward integration tracks have not been run with the NTCM because of 
the expense of conputer time for this many cases. The objective of this experi- 
moit is to use bacl^ward extrapolation positions in lieu of backward integration 
tracks, and yet improve the track forecasts by ranoving sane of the systanatic 
bias . 

In these tests, the 186 cases are randonly divided into a 124-case depen- 
dent sample and a 62-case independent sample. In an attenpt to provide similar 
error bias characteristics between the dependent and independent samples, several 
randan samples were analyzed, and the samples wMch had the most canparable error 
biases were used. For tdiis reason, different dependent and independent samples 
were chosen for the zonal-meridional schene tests than for the storm-coordinate 
tests . It can be seen in Fig . 5 that the systematic zonal and meridional bias 
trend is similar between the dependent and independent samples. The independent 
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AY CRROR 





Fig. 5 Mean zonal (ax) and meridional Fig. 6 Mean right angle and speed 
(Ay) errors (n.mi.) of OTGM errors (n.mi.) of OTCM 

dependent (A) and independent dependent (A) and independent 

(i) samples 




Fig. 7 Mean NTCM forecast errors (n.mi.) for 186 western north 
EScific tropical cyclone cases. Mean errors are 
depicted for the urroodified (U>WCD) and zonal-flier id ional 
regression modified (MCD) dependent (DEP) and independent 
(IND) samples 
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sample, hovvever, has a more negative meridional bias and, at later forecast 
times, a less negative zonal bias. The independent sample for the storm coordi- 
nate tests (Big. 6) has a more negative speed bias and a more positive right 
angle bias at later forecast times, although the trend is again similar. These 
differences may indicate the necessity of a larger sample, 
b. Zonal -Meridional Mjustment Test 

Zonal and meridional regression equations vere derived for the 124 case 
dependent sample using the backward extrapolation positions. The reduction in 
variance by the regression equations ranged fron 12% to 41% and averaged 26%. 

This is considerably less than the reduction in variance by the TCM backward in- 
tegration and backward extrapolation schemes . If the experience with the TCM 
tests is a valid guideline, a NTCM backward interpolation schane may not be able 
to reduoe significantly the variance. Qa the other laand, the snaller reduction 
in variance may indicate that the NTCM 12 h, 24 h and 36 h positions do not 
rev^l as much information about the backward track bias as would a model 
integration . 

The mean forecast errors ( Fig . 7 ) of the independent sample are only 
slightly larger than those of the dependent sanple fron 12h to 48 h, but they are 
27 nni and 29 rmi larger at 60 h and 72 h. This may be another indication that 
the sanple sizes are too anall . 

The regression scheme is very successful in reducing both the means and 
standard deviations of the zonal and meridional error biases in the independent 
sample (Table 4) . This reduction is noteworthy considering the differences in 
these biases (shown in Fig. 5), and indicates that even though the regression 
equations are unable to reduce much of the variance, most of the systanatic error 
in the sample is reduced by the equations . 
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TABLE 4 



OTCM independent sample means (X) and standaz-d deviations (a) (mi) of zonal 
and meridional error bias before and after regression modification. 



NTCM ERROR BIAS 



ZCNAL MERIDIONAL 



Rsrecast 
Time (h) 


Nunber 
of C^ses 


X 


a 


X 


a 


12 


62 


10 


59 


-21 


64 


24 


62 


~8 


97 


-14 


97 


36 


62 


-19 


128 


-25 


127 


48 


62 


-28 


180 


-21 


164 


60 


54 


-20 


224 


-35 


192 


72 


53 


-39 


295 


-20 


229 


Ebrecast 
Time (h) 


Nunber 
of C&ses 


REGRESSION ERROR BIAS 
ZOjIAL 
X 0 


MERIDIONAL 
X 0 


12 


62 


-6 


48 


0 


51 


24 


62 


-4 


86 


4 


84 


36 


62 


-6 


117 


2 


112 


48 


62 


-1 


170 


10 


152 


60 


54 


4 


194 


-10 


167 


72 


53 


10 


249 


-a 


184 



24 



The post processing decreases the mean forecast error ( Fig . 7 ) of the de- 
pendent sample by 15-20 rmi frcm 12 h to 48 h, and decreases the error by 28 rmi 
at 60 h and 52 nmi at 72 h. The modified independent sample errors show the same 
error decrease frctn 12 h-48 h, and even more decrease at 60 h (38 mi) and 72 h 
(61 nmi) . Scatterplots of the unmodified independent sample forecast errors vs 
the regression modified forecast errors (Fig. 8) reveal that the regression 
scheme improves the forecasts of about 2/3 of the cases at 24 h, 48 h and 72 h. 
Thus, 1/3 of the NTCM forecasts are actually degraded by the regression correc- 
tion. Better regression equations frcm a larger sample might be able to improve 
poor forecasts without degrading the good forecasts. It is also possible that 
more stratified samples (e.g. dependent on recent tracks) might be used for de- 
veloping improved regression equations. 

An alternative method of reducing the bias might be to simply add the 
mean bias value of a dependent sample to each case. Hawever, because the error 
for a particular case is a function of track direction and speed, this 'direct 
bias ranoval' method does not necessarily produce improved forecasts, even though 
the bias is eliminated (Table 5). This indicates the advantage of using a 
statistical scheme to eliminate bias, 
c . Storm-Coordinate Itest 

R>r this study, new dependent and independent samples v^re randonly 
chosen because the right angle and speed error biases of the previous samples are 
quite dissimilar. Ifew predictors vere defined to include the right angle and 
speed errors of the -12 h, -24 h and -36 h positions. Regression equations 
derived for the right angle and speed correctors of the new dependent sample show 
a 13% to 44% reduction of variance, and an average of 26%. The average variance 
reduction was about the same between the right angle and speed error equations, 
exceprc. that the 12 h position correctors of the right angle error reduced the 
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NTCM 72H FORECAST ERROR 



Fig. 8 Scatterplots of NTTCM independent sample forecast errors 
(n.mi.) versus zonal-meridional regression modified 
independent sample forecast errors for a. 24 h forecast, 
b. 48 h forecast and c. 72 h forecast 



26 



Ti^BLE 5 



Mean tTTCM forecast errors (rmi), zonal (Ax) error bias, and meridional (Ay) 
error bias before and after direct bias ranoval. 



Dependent Sample 





Before 


Direct 


Bias Ranoval 


After 


Direct Bias 


Removal 


RDrecast 


RDrecast 


Zonal 


Meridional 


Ebrecast 


Zonal 


Meridional 


Time 


Error 


Bias 


Bias 


Error 


Bias 


Bias 


12 


72 


12 


-13 


70 


0 


0 


24 


112 


-4 


-1 


112 


0 


0 


36 


154 


-20 


-9 


153 


-1 


0 


48 


206 


-43 


-4 


204 


-1 


0 


60 


242 


-A2 


-15 


237 


-2 


0 


72 


309 


-71 


-2 


300 


-3 


0 








Independent Sample 








Before 


Direct 


Bias Pamoval 


After 


Direct Bias 


Ranoval 


Ebrecast 


Ebrecast 


Zbnal 


>teridional 


Ebrecast 


Zbnal 


>teridional 


Time 


Error 


Bias 


Bias 


Error 


Bias 


Bias 


12 


78 


10 


-21 


75 


-2 


-7 


24 


118 


-8 


-14 


118 


-4 


-13 


36 


157 


-19 


-25 


156 


0 


-16 


48 


215 


-28 


-21 


213 


14 


-17 


60 


269 


-20 


-35 


266 


22 


-20 


72 


339 


-39 


-20 


338 


29 


-19 



variance by approximately 43% and the speed error correctors reduced the variance 
by only 14%. The right angle equations typically included as predictors the zonal 
displacanent fron the -12 h extrapolated position to the initial position and the 
right angle error of the -12 h position canpared to the -12 h best track. The 
speed error equations typically included the meridional initial position to -24 h 
position displacanent and the initial storm longitude. This may indicate that 
the speed error bias is mainly in the zonal track displacement and is dependent 
on how far v^st the storm is located. 

The mean forecast errors of the new dependent sample are similar to the 
old sample, but the new independent sample has a much analler error at 60 h and 
72 h (lig. 9). The regression scheme has little effect on the error of either 
the dependent or the independent samples frcm 12 h to 48 h, even though the bias 
is significantly reduced (Table 6). By 60 h and 72 h there is some improvanoat 
(32 rmi at 72 h for the dependent and 22 rmi for the independent) but the error 
reduction is still not as large as in the zonal -meridioncLL schane. It shoiiLd be 
recalled that once the regression correctors for a position were determined, the 
ambiguity described in Section 3 had to be resolved to apply the correctors. 

Sate of the forecast error is due to this factor. The regression modified tracks 
improve only half of the cases at 24 h and 48 h, and slightly more than half of 
the cases at 72 h (Fig. 10) . The statistical schone apparently cannot capture 
the error dependence in storm coordinates . Part of the reason for this is that 
an adjustment for speed error causes a change in the calculation of the right 
angle error . The interrelation betv^en the speed and right angle errors makes 
this approach difficult to interpret. 

The speed errors (Table 6) for the unmodified dependent and independent 
samples are almost constant frcm 12 h to 72 h, although the values are analler 
for the independent sample. The right angle errors are generally small in both 
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MEAN ERROR 




Fig. 9 As in Fig. 7, except for right angle/speed error 
regression scheme 
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TABLE 6 



Mean OTCM error bias (rmi) before and after regression modification using 
right angle/ speed error regression. 



DEPENDENT 

UNMODIFIED MODIFIED 



Ebrecast 


Nunber 


Right 




Right 




lime 


of C^ses 


Angle 


^seed 


Angle 


^)eed 


12 


124 


21 


-33 


6 


-9 


24 


124 


16 


-50 


-4 


-10 


36 


124 


17 


-49 


-4 


-14 


48 


123 


5 


-52 


0 


-17 


60 


108 


1 


-42 


-1 


-18 


72 


106 


-12 


-67 


-5 


-18 








ZNIEPENDENr 










UNMODIFIED 


MODIFIED 


Etorecast 


Nunber 


Right 




Right 




Time 


of Gases 


Angle 


^)eed 


Angle 


^56 ed 


12 


62 


20 


-30 


9 


-9 


24 


62 


13 


^0 


-3 


4 


36 


62 


16 


-31 


1 


10 


48 


62 


13 


-37 


14 


-1 


60 


54 


10 


-24 


11 


-9 


72 


53 


-18 


-47 


-24 


-35 
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Fig. 10 



As in Fig. 8, except for right angle/speed error 
regression 
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samples. It may be reasonable then to simply add right angle and speed 
correctors equal to the mean values. This vas done using the dependent sample 
right angle and speed error mean value correctors on both samples (Tbble 7). The 
bias is reduced, but because of the ambiguity problem, there is still seme bias 
after this direct bias ranoval. Furthermore, the forecast errors are made worse, 
indicating that a simple correction factor approach will not work, 
d. Tests with 1981 Data 
(1) Analysis cases 

Both post-processing schemes have been tested with a new independent 
sample of 87 NTCM runs frem the 1981 typhoon season. These cases are not the op>- 
erational model forecasts initialized with 12 h forecast fields. lather, they are 
the model runs initialized with analysis fields. Best track positions are not yet 
available for 1981 storms, so warning tracks have been used in the verifications. 

New regression equations have been derived using all 186 cases frem 
the previous dependent and independent samples . The reduction in variance by the 
equations ranged frem 10% to 45% and averaged 27%. This is slightly more than 
the reduction in variance by the dependent sample alone. 

The error bias characteristics of the 1981 cases is somewhat differ- 
ent from those of the 1975-1980 cases. The mean zonal and meridional errors of 
the new sample depicted in Fig. 11 may be compared wdth those in Fig. 12. The 12 
h and 60 h errors are similar to the previous cases . The 24 h-48 h zonal errors 
are also about the same as before, but the meridional biases are the opposite 
sign. There is practically no bias in the new 72 h forecasts. 

The mean forecast errors for the 1981 cases (Fig. 13) are generally 
larger than in the earlier sample (Fig. 7), except at 72 h. The zonal -meridional 
regression schane provides a snail improvanent in the 12 h-36 h forecast errors, 
but degrades the forecasts from 48 h to 72 h. The regression equations, being 
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TABLE 7 



Mean NTCM independent sample forecast error (rmi), right angle error bias, 
and speed error bias before and after direct bias ranoval. 

Dependent Sarrple 





Before 


Direct Bias Ranoval 


After 


Direct Bias Ranoval 


Rjrecast 


Forecast 


Right Angle 


^5eed 


Forecast 


Right Angle 


^jeed 


Time 


Error 


Bias 


Bias 


Error 


Bias 


Bias 


12 


75 


21 


-33 


83 


6 


-10 


24 


116 


16 


-50 


127 


3 


-11 


36 


156 


17 


^9 


166 


3 


-10 


48 


212 


5 


-52 


225 


1 


-9 


60 


258 


1 


-42 


270 


0 


-8 


72 


329 


-12 


-67 


350 


-2 


-13 



Independent Sanple 





Before 


Direct Bias Ranoval 


After 


Direct Bias Ranoval 


Forecast 


Forecast 


Right Angle 


^need 


Forecast 


Right Angle 


^need 


Time 


Error 


Bias 


Bias 


Error 


Bias 


Bias 


12 


72 


20 


-30 


77 


5 


-5 


24 


110 


13 


-40 


121 


0 


0 


36 


153 


16 


-31 


168 


1 


10 


48 


205 


13 


-37 


220 


9 


6 


60 


238 


10 


-24 


253 


10 


12 


72 


301 


-18 


-47 


324 


-9 


7 
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40 
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Fig. 11 Mean zonal (ix) and meridional ^^9* 12 Similar to Fig. u except for 
(ay) errors (n.mi.) of 87 OTCM 186 NTCM 1975-1978 cases 

1981 cases 




FORECAST TIME (H) 



Fig. 13 Mean l/TCM forecast errors (n.mi.) for 87 1981 cases; 
unmodified (Ui'MCB) , and modified (MCO) with zonal- 
meridional regression equations (ax/ay) and with 
right angle/speed error equations (RA/SP) from the 
dependent sample 
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derived frcm the pre-1981 cases, ailvays correct for error biases pertinent to 
that sample. When the biases deviate fron their expected behavior, especially to 
the extent of beir^ of the opposite sign as in these cases, the regression equa- 
tions are correcting for the wrong errors. 

The characteristics of the predictors are also different in the new 
cases. Tb illustrate, the zonal regression equation to correct for bias in the 
60 h forecast is : 

D)«:R60 = 139.94-10.83 XXIAT-0.91 ByER12-8.85 VX6072+13.10 VY0012 (1) 

where D>3CR60 = zonal correction (rmi) for 60 h forecast 
XXLAT = initial storm latitude (degrees) 

BYER12 = meridional error of the -12 h extrapolated position 
VX6072 = zonal ccmponent of storm velocity frcm 60 h - 72 h 
VY0012 = meridional ccmponent of storm velocity frcm 00 h - 12 h. 

Since the ecjuation is linear, it holds for average values of the variables as 
well. Frcm the pre-1981 sample, XXIAT = 19.3, BYER12 = 19.4, VX6072 = 2,9, and 
VY0012 = 5.9. Using these values in (1), DXCR60 = -35.1 nmi vhich is a gocd 
prediction of the actual value of -35.8 mi Frcm the 1981 cases, XXIAT = 18.9, 
ByER12 = 26.6, VX6072 = -1.9, and VY0012 = 7.0 resulting in DXCR72 = +19.6 mi 
vhich is an incorrect cxirrection of the actual value of -35.8 mi. 

There is enough difference in the model performances on this 
season’s storms to make the ecjuations based on past performance inappropriate. 
This indicates a need far a larger sample of model runs frcm ’.hich to derive the 
regression ecjuations. If a large enough sample is used, the equations should be 
able to account for snail seasonal variations in model forecast characteristics. 
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( 2 ) Operational C^ses 

Both post-processing schemes have been tested with a sample of 67 
NTCM operational runs fron the 1981 typhoon season. Ihe model was initialized 
'with 12 h forecast fields in these cases . 

The error biases of these cases are considerably different frcm the 
biases of the pre-1981 cases (Fig. 16 vs Fig. 12 and Fig. 17 vs Fig. 15), 
especially in the meridional and speed error conponents. The forecast errors 
(Fig. 18) are progressively larger, and are approximately 170 mi leirger at 
72 h. Because of these differences, the regression equations have generally 
detrimental effects on the forecast errors. 

5. Ttests of Past-Processing for the Operational TOM 
a. Description of Data Sample 

The tfevy Che-Way Interactive Tropical Cyclone Madel (TCMO) forecasts dur- 
ing the 1980-1981 typhoon seasons had accuracies competitive with the NTCM (N&t- 
sumoto, 1981) . Bawever, if a systematic bias exists in the TCMO forecasts, a re- 
gression correction should provide even better forecast guidance. 

A data base of 212 operational TCMO forecasts on 40 storms frcm 1979-1980 
v\as kindly provided by T. Tbui of NEPRF for this study. The 12 h, 36 h and 60 h 
forecast positions vere not archived by FNOC, so those positions have been inter- 
polated to provide the 12-hourly positions needed to derive the backward extra- 
polation positions . 

The TCMO forecast tracks tend to be west and slightly north of the storm 
track (Fig. 19 and Tbble 8) . The small lx biases at 12 h and 24 h, and the smeLLl 
3y bias throughout the forecast, indicate that the 3iewchuk-El sberry adjustment 
schene effectively corrects for the meridional bias and 00-24 h zonal bias. In 
storm coordinates , the model tracks are usually to the left of the actual track 
and are slow (Fig. 20 and Tbble 8) . The randcm division of the data into 
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Fig. 15 Similar to Fig* 14 except 

for 186 NTCM 1975-1978 cases 



Fig. 14 Mean right angle and speed errors 
(n.mi.) of 87 1981 OTCM cases 
rtn from analysis fields 





Fig. 16 Mean zonal (Ax) and meridional 
(Ay) errors (n.mi.) of 67 1981 
NTGM cases rtn from 12 h 
forecast fields 



Fig. 17 Mean right angle and speed errors 
(n.mi.) of 67 1931 NTC'l cases rin 
from 12 h forecast fields 
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FORECAST TIME (H) 

Fig. 18 Similar to Fig. 12 but for 67 1981 NTCM cases run from 
12 h forecast fields 





RIGHT ANGLE ERROR 



Fig. 19 Mean zonal (Ax) and meridional 
(Ay) errors (n.mi.) of ICMO 
dependent (a) and independent 
(1) samples 



Fig. 20 Mean right angle and speed errors 
(n.mi.) of TCMO dependent (a) 
and independent (a) samples 
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TABLE 8 



Cperational one-vvay interactive tropical cyclone model (TG40) forecast 
errors (rmi), 12, 36 and 60 h positions interpolated. 





Nunber 


Fbrecast 


Zonal (ax) 


Meridional (Ay) 


Right Angle 


Speed 


Time 


of Cbses 


Error 


Error Bias 


Error Bias 


Error Bias 


Error Bias 


12 


212 


65 


-4 


7 


—8 


-28 


24 


212 


119 


-4 


13 


-12 


-58 


36 


212 


181 


-49 


19 


-33 


-75 


48 


212 


253 


-94 


24 


-55 


-98 


60 


157 


278 


-101 


6 


-75 


-64 


72 


157 


355 


-139 


—0 


-100 


-72 







TABLE 
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TCMO 


independent sample 


means (X) and 


standard 


dev ia t ions ( a ) ( rmi ) 


of zonal 


and meridional error bias before and after 


regression modification. 








TCMD ERROR BIAS 










ZONAL 




MERIDIONAL 




Fbrecast 


Nunber 










Time (h) 


of Chses 


X 


a 


X 


a 


12 


71 


-6 


58 


2 


45 


24 


71 


-10 


108 


4 


81 


36 


71 


-55 


160 


12 


129 


48 


71 


-100 


222 


20 


187 


60 


55 


-96 


254 


11 


183 


72 


55 


-133 


336 


15 


256 






FEGRESSIC»J ERROR BIAS 










ZONAL 




MERIDIONAL 




Fbrecast 


Nunber 










lime (h) 


of Chses 


X 


a 


X 


a 


12 


71 


-2 


44 


-6 


47 


24 


71 


-7 


74 


-11 


83 


36 


71 


-5 


118 


-11 


124 


48 


71 


-14 


198 


-6 


178 


60 


55 


-14 


238 


13 


193 


72 


55 


-19 


324 


24 


239 
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dependent (141 cases) and independent (71 cases) sets provided very \Aell -matched 
bias characteristics in the zonalnteridional samples (Fig. 19) and well-matched 
right angle- speed error biases (Fig. 20). 

b. Zonal-Meridional Cbrrection Tests 

Zonal and meridional regression equations vsere derived for the 141 -case 
dependent sample using backward extrapolation positions. The variance reduced by 
the equations ranges fran 8% to 45%, and averages 21%. The zonal equations gen- 
erally resialted in a greater reduction in variance than did the meridional equa- 
tions, except at 72 h. 

The regression scheme decreases the forecast error of the dependent 
sanple by 18 rmi, 35 mi and 76 rmi at 24 h, 48 h and 72 h respectively (Fig. 

21). The mcdified independent sample errors are decreased 16 mi, 27 mi and 37 
nti at 24 h, 48 h and 72 h. As in the OTCM tests, the independent sample error 
is decreased significantly, but the decrease is not as large. The decrease in 
zonal bias of the independent sample is considerable (Tbble 9). Furthermore, the 
standard deviations of the zonal and meridional errors are generally decreased by 
the regression modificaticn. The track error after the regression correction is 
less than the unmcdified track error in almost 2/3 of the 71 cases (Fig. 22). 

The storm-coordinate schone vas also attanpted for the TCMO tracks but 
produced average errors about the same or larger than the unmodified TCMO. 

c. Ttests with 1981 TCMO forecasts 

Pcst-processing has also been tested with a new independent sample of 69 
TCMO runs fron the 1981 typhoon season. The 12 h, 36 h and 60 h positions were 
available in this case, ^'feming track positions v^ere used for track verification. 

The zonal error biases of these cases are similar to the previous cases 
(Fig. 23 versus Fig. 24), but are larger at 60 h and 72 h. The meridional bias 
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MEAN ERROR 




Fig. 21 Mean TCMO forecast errors (n.mi.) for 212 western 

north Facific tropical cyclone cases. Mean errors are 
depicted for the urmodified (UM^CD) and zonal- 
meridional regression modified (MCD) dependent (DEP) 
and independent (IND) samples 
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Fig. 22 Scatterplots of TO^O independent sample forecast 
errors (n.mi.) versus zonal-meridional regression 
modified independent sample forecast errors for 
a. 24 h forecast, b. 48 h forecast, and 
c. 72 h forecast 
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Fig, 23 Mean zonal (4x) and meridional 
(Ay) errors (n.mi.) of 69 1981 
TQMO cases 



AX ERROR 




Fig. 24 Similar to Fig. 23 except for 
212 TCMO 1979-1930 cases 




Fig. 25 Mean TCMO forecast errors (n.mi.) for 69 1981 cases; 
unmodified (UMMCO) and modified (MCD) with zonal- 
meridional regression euqations from the dependent 
sample 
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is larger and of the opposite sign at 36 h and 48 h. Ihe forecast errors for the 
new sample are about the same as for the earlier runs (Elg. 25 versus Fig. 21). 
The differences in error bias keep the zonal-meridional regression equations firon 
improving the forecasts fron 12 h to 36 h, but they still are able to provide 
considerable improvonent at 60 h and 72 h. 

The storm-coordinate error biases for these 1981 cases are different fron 
the 1979-1980 cases (Fig. 26 versus Fig. 27), especially the speed error frcm 48 
to 72 h. Nevertheless, the forecast errors are reduced at 60 h and 72 h (Fig. 25) 
by about the same amount as the zonal-meridional schone improvonent. 

6. Conclusions 

A statistical technique using multiple linear regression equations to renove 
sy St ana tic bias in TCM track forecasts has been developed by Elsberry and Frill 
(1980) . The value of the technique has already been established by Elsberry and 
Frill for an earlier version of the TCM, and for HATPACK (Elsberry, Gilchrist and 
Peak, 1981). The pxjrpose of this report is to evaluate the applicability of the 
schone to the TCMO and NTCM models. 

The main disadvantage of the post-processing technique is the time and cost 
of integrating the model backward to determine -12, -24 and -36 h positions to be 
conpared with the corresponding prior storm positions. This canparison is crucial 
in statistically determining the corrections to be made to the forward model 
forecast . A possible alternative explored here is to use simple backward extra- 
polation of the +36 h track forecast. This method is shown to provide the sane 
HATRACK forecast accuracies as those vhich result fron using backward integration 
positions. When tested with TCM tracks, the backward extrapolation scheme reduces 
the forecast errors by about 1/2 of the reduction made vhen using backward inte- 
gration. This indicates some value in the correction scheme in an application to 
a dynamic model for \>hich it is more costly to provide a backward integration. 
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Fig. 26 Mean right angle and speed errors 
(n.mi.) of 69 1981 TCMO cases 




Fig. 27 Similar to Fig, 26 except for 
212 TCMO 1979-1980 cases 
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A method is devised for correcting right argle and speed error biases with 
the regression scheme. Because the definition of right angle and speed error is 
dependent on the best track position (the predictard in the schene) , there is 
seme ambiguity vvhen attempting to apply the regression correctors. Rales have 
been fbmulated to select the most likely of the arabiguDus positions . 

The zonal -meridional regression scheme with backward extrapolation decreases 
the NTCM and TCMO 72 h independent sample forecast errors by 61 nni and 37 nni 
respectively. If the TCM cemparisons between backward extrapolation and backward 
integration are valid, then it can be expected that using backward in- 
tegration positions would provide even more improvemoit. 

Dynanical typhoon track models usually forecast storm paths better than storm 
speeds. Thus, it would be desirable to use the storm-ooordinate scheme to correct 
for speed error bias. The tests with the schane improved the OTCM 72 h indepen- 
dent sample forecast error by only 22 nmi. ^parently the storm-ooordinate scheme 
cannot capture as much error bias dependence. The speed error regression equa- 
tions typically include the 00 to -24 h zonal displacement and the initial storm 
longitude as predictors. This may indicate that a zonal correction schene already 
accounts for the speed error bias, thus making a storm coordinate scheme 
unnecessary. 

Analysis of seme iTTCM forecasts fron the 1981 season reveals that the NTCM 
error bias is different fron that displayed during previous seasons. The regres- 
sion scheme does not reduce forecast errors in this sample, because the differ- 
ences in model bias and predictor values tend to invalidate the regression equa- 
tions . This seems to indicate the need for a larger sample size . 

Although the zonal-meridional schane provides encouragirg results, there are 
limitations to its use. Storms must have a 36 h Mstory, the mcdel forecast must 
extend at least to +36 h, and most importantly, the model must perform 
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cxDnsistently. If the bias characteristics change fran season to season, as the 
NTCM has in 1981, the regression schene will result in a misapplication of the 
bias correctors. When the tropical cyclone models begin to be run frcm NDGAPS 
fields, rather than FNOC hanispheric model fields, there may be different biases 
and hopefully, smaller systematic errors than presently exist. Frcm this study, 
it appears that post-processing of the tracks, using zonal and meridional correc- 
tors, will continue to improve the forecasts. 



47 



LIST CF REFERENCES 



ELsberry, R. L. and D. R. Frill, 1980: Statistical processing of dynamical 

tropical cyclone model track forecasts. Mon . Vfea . Rev . , 108 , 1219-1225. 

Elsberry, R. L. , R. C. Gilchrist and J. E. Peak, 1981: Statistical post- 

processing of HATRACK tropical cyclone track forecasts • To appear in 
Papers in Meteorological Researdi , 'Ihe Meteorological Society of the 
Republic of China. 

Harrison, E. J. , 1981: Initial results frcm the ihvy tvso-way interactive 

nested tropical cyclone model. Mon. Wea. Rev . , 109 , 173-177. 

Bferrison, E. J. and M. Fiorino, 1982: A comprehensive test of the ifevy nested 

tropical cyclone model. Sutmitted to Mon. Wea. Rev . 

Matsumoto, C. R. , 1981: Evaluation of the thvy two-way interactive TCM (NTCM) . 

1980 Annual Tropical Cyclone Report, U. S. Fleet Vfeather Central /Joint 
Typhoon Whming Center, Guam. 

Shewohuk, J. D. and R. L. Elsberry, 1978: Improvonent of short-term dynamical 

tropical cyclone motion prediction by initial field adjustments. 

Mon. Wea. Rev., 106, 713-718. 



48 



DISTRIBUTION LIST 

No . Copies 

1. Efefense Technical Information Center 2 

Cameron Station 

Alexandria, Virginia 22314 

2. Library, Code 0142 2 

Naval postgraduate School 

Monterey, California 93940 

3. Etepartment of Meteorology Library 1 

Code 63, Naval Postgrad uage School 

Monterey, California 93940 

4. Dr. Russell L. Elsberry, Code 63Es 7 

Naval Postgraduate School 

Monterey, Chlifoimia 93940 

5. Mr. James E. Peak, Code 63Pj 3 

Naval Postgraduate School 

Monterey, California 93940 

6. Oiairman, Department of Meteorology 1 

California State Olivers ity 

San Jose, California 95192 

7. Chairman, Etepartment of Meteorology 1 

Massachusetts Institute of Ttechnology 

Cambridge, Massachusetts 02139 

8. Chairman, Etepartment of Meteorology 1 

Pennsylvania State Oiiversity 

503 Iteike Building 

University Eterk, Etennsylvania 16802 

9. Chief, Marine and Ebrth Sciences library 1 

NCAA, Etepartment of Cfcrmierce 

Rockville, Maryland 20852 

10. Chief of thval Operations (OP-952) 1 

Navy Etepartment 

Was'nington , D. C . 203 50 

11. Ocmmander 1 

Naval Air Systems Conmand 

AIR-370 

Washington, D.C. 20361 

12 . Commander 1 

Naval Air Systems Camiand 

AIR-553 

Washington, D.C. 20360 



49 



13. 



1 



Ctnrnander 

Naval Cceancgraphy CoTTnand 
NSTL Station 

Bay St Louis, Mississippi 39529 

14. Cottnanding Officer 

Fleet Numerical Oceanography Center 
Monterey, California 93940 

15 . Ccnmanding Officer 

Naval Ehstem Oceanography Center 
McMie Bldg (U-117) 

Naval Air Station 
Norfolk, Virginia 23511 

16. Qonmanding Officer 

U. S. Naval Oceanography Catmand Center 
Box 12, 0>!NAVMARIANAS 
FPO San Francisco 96630 

17. Ocmmanding Officer 

Naval Research Laboratory 
AmST: Library, Code 2620 

Washington, D.C. 20390 

18. Ctnmanding Officer 

Naval Western Oceanography Center 
Box 113 

Pearl Jferbor, Hawaii 96860 

19. Cepiartment of Atmospheric Sciences 

AITN: Librarian 

Colorado State University 
Port Collins, Colorado 80521 

20. Department of Atmospheric Sciences 
University of Washington 
Seattle, Washington 98195 

21. Department of Meteorology 
University of Ibwaii 
2525 Correa Road 
Honolulu, Ibwaii 96822 

22. Departmerit of Oceanography, Code 68 
Naval Postgraduate School 
Monterey, California 93940 

23. Director 

Atlantic Oceanographic and ^teteorology Labs. 

15 RLckenbacker Causeway 

Virginia Key 

Miami, Florida 33149 



1 

1 

1 

1 

1 

1 

1 

1 

1 

1 



50 



24. 



1 



Mr . Mike Fiorino 
Naval Envirormental Prediction 
Research Facility 
Monterey, California 93940 

25. CER E. J. Fferrison, Jr. 1 

Naval Envirormental Prediction 

Research Facility 
Monterey, California 93940 

26. Dr. Tted llsui 1 

Naval Envirormental Prediction 

Research Facility 
Monterey, California 93940 

27. Office of Research Mministration ((3ode 012A) 1 

Naval Postgraduate School 

Monterey, California 93940 

28. Superintendent 1 

Library inquisitions 

U. S. Ffeval Aoademy 
Annapolis, Maryland 21402 



51 



U2022 59 



DUDLEY KNOX LIBRARY - RESEARCH REPORTS 




5 6853 01068015 0 



